Method for the creation of interactive audio-video contents of the live-action type for mobile terminals, electronic system for the implementation of the method, and mobile terminal for using the method

ABSTRACT

A method is described for the creation of interactive audio-video contents, through visualization on an interactive display, comprising the following steps:—providing at least one set of interconnected video segments (101), adapted to evolve in time, comprising an initial video segment (START) and one or more final video segments (END1, . . . ENDn), each video segment comprising a non-interactive video clip (102) having a given, or even null, duration, and an interactive node (103), said interactive node acting as an interconnection with one or more other video segments, each interactive node comprising a loop interval (TLi, TLf) subject to continuous cyclical forward and backward time evolution, —providing at least one set of commands (202) adapted to determine connection choices among said video segments, wherein said commands can be activated during at least one of said loop intervals, —in at least one of said loop intervals, association between said commands and video segments of said one or more other video segments, —upon activation of a command during said loop interval, exiting said interval and continuing in that video segment of said one or more other video segments in which, said interactive audio-video content continues, depending on the command chosen from said set of commands, starting from said initial video segment (START) and ending in one of said final video segments (END1, . . . ENDn), so as to create an interactive audio-video content on said interactive display as a sequence of said video segments.

FIELD OF APPLICATION OF THE INVENTION

The present invention relates to a method for the creation ofinteractive audio-video contents of the live-action type for mobileterminals, an electronic system for the implementation of the method,and a mobile terminal for using the method.

STATE OF THE ART

It is known that in the near future video contents will be enjoyedespecially through mobile devices/terminals such as smartphones andtablet. Such devices, equipped with a plurality of sensors andactuators, can add to the audiovisual experience also the possibility ofuser/spectator interaction and content interaction, which is afundamental element in processes for information acquisition/storage.For example, these may include applications for training or advertisingpurposes.

It is known that it is possible to create hypervideos, i.e. videostreams containing anchors or links (also referred to as hyperlinks)clickable by the user, which allow navigation among videos and otherhypermedia elements.

It is known that it is possible to modify the narrative development of avideo by combining different video clips into a linear informationstructure, permitting choices based on the user's interests, whichchoices are made through elementary commands issued by pressing keys ofremote controls or keyboards or by tapping directly on the display.

It is known that it is possible to add overlays or hyperlinks orhotspots to a video content through dedicated software (video editors)or through several online portals that permit the creation ofinteractive contents.

However, such portals or video editors are characterized by a practicallimitation, since they only allow either adding digital contents(generally banners and/or links) to the video clip itself or switchingbetween two narrative sequences by means of an elementary command: the“choice”, i.e. pressing a key or tapping on the screen, thus leavingunsolved the technical problem of interactions only with the digitalcontents added to the video clip or simple interactions (taps) with thevideo clip itself.

In fact, the currently known possibility of interacting with a videoclip exclusively through overlays/hyperlinks or through the elementary“choice” command does not allow the user to control the two fundamentaland indispensable elements of the video clip itself, i.e. timeline andframe-rate, exploiting the whole plurality of sensors and actuatorsincluded in the mobile device.

It is known that it is possible to build audio/video contents in whichthe video clip succession is not predefined, but is composed—even inreal time—upon request and/or upon a user's command, wherein, however,the switching from one clip to the next occurs through instantaneous,fixed cuts from the initial clip to the target clip, sometimes softenedby fading or blending effects. In order to obtain different kinds ofclip evolution, the user chooses one of several clips available, with afixed, instantaneous transition between them.

Therefore, the technical problem addressed by the present invention isto improve the interaction between user and system for the creation ofaudio-video contents, returning an interaction not characterized bysequence cuts, but soft, continuous and natural, through an interactionsystem that makes use of all sensors and actuators included in themobile terminal and through intelligent timeline and frame-ratemanagement.

It is known that in videogame applications it is possible to interactwith the fundamental elements of a story (characters, environments,objects) or a narrative scenario (set of stories and their fundamentalelements, i.e. characters, environments, objects). Such possibility isexploited also in the advertising and/or training fields to allow theusers to interact with testimonials and/or products and/or servicesand/or information for the purpose of memorizing/learning/knowingqualities of testimonials and/or products and/or services and/orinformation. In the videogame field, however, the fundamental elementsof a story (characters, environments, objects) or a narrative scenario(set of stories and their fundamental elements, i.e. characters,environments, objects) are the results of computer graphics processing(3D models) and, as photorealistic as they may be, cannot compare to theunquestionable realism of a video film (also known as live action).

Therefore, a further technical problem addressed by the presentinvention is to give the possibility of interacting with the fundamentalelements of a story (characters, environments, objects) or a narrativescenario (set of stories and their fundamental elements) in the filmingfield without by any means manipulating the appearance of testimonialsand/or products and/or services and/or information (as is the case invideogame applications), but through the unquestionable realism of avideo film (also referred to as live action).

At the same time, another problem arises: computer graphics (3D models)is the result of a process that requires the modelling ofplanes/cubes/parallelepipeds/spheres/cylinders/cones/pyramids through 3Dsoftware. Therefore, proposing testimonials and/or products and/orservices and/or information through computer graphics is an activitythat requires specific skills and tools that are accessible to a smallpercentage of users only. On the contrary, creating a video clip ispossible through devices of everyday use (smartphones, tablets,computers) accessible to a much greater, even massive, percentage ofusers.

Therefore, a further technical problem addressed by the presentinvention is to allow a massive percentage of users (the so-calledfilm-makers) to create and propose interactive contents relating totheir own testimonials and/or products and/or services and/orinformation without necessarily having to resort to specific computergraphics skills and tools, but simply through devices of everyday use(smartphones, tablets, computers).

At the same time, a further problem arises: computer graphics (3Dmodels) is the result of a process that requires a plurality of softwarepackages and tools, the economical cost of which amounts to severalthousands of Euros. Therefore, proposing interactive contents withtestimonials and/or products and/or services and/or information throughcomputer graphics is an activity that requires economic resourcesaccessible to a small percentage of users only. On the contrary,creating a video clip is possible through devices of everyday use(smartphones, tablets, computers) that require no further costs inaddition to the cost of the device of everyday use (already purchased)and that are accessible to a much greater, even massive, percentage ofusers.

Therefore, a further technical problem addressed by the presentinvention is to allow a massive percentage of users (the so-calledfilm-makers) to propose interactive contents relating to their owntestimonials and/or products and/or services and/or information withoutnecessarily having to incur any further costs in addition to thepurchase of their own device of everyday use, as opposed to having toresort to a plurality of software applications and tools necessary forcomputer graphics.

SUMMARY OF THE INVENTION

It is therefore the object of the present invention to propose a methodfor the creation of interactive audio-video contents of the live-actiontype for mobile terminals, an electronic system for the implementationof the method, and a mobile terminal for using the method, which intendto overcome all of the above-mentioned problems.

It has been verified that no video editor currently exists which iscapable of associating “gestures” from a touch-screen and/or fromsensors (e.g. gyroscopes, microphones, cameras, etc.) of smartphones andtablets with video clip-related commands/controls, thus making alive-action video interactive.

According to the present invention, video clip-related interactionsrefer to controls and commands that allow manipulating/modulating thetimeline and/or compositing levels of a video clip. This means,therefore, the possibility of controlling the video timeline orframe-rate to control the direction in time (forwards and/or backwards)or the speed (to increase and/or reduce the speed) of the video clip; infact, while overlays and hyperlinks are, de facto, a supplementary(additional) element added to the video clip (a video clip may have nooverlays or hyperlinks, since overlays and hyperlinks are not essentialelements for the fruition of a video clip), a video clip mustnecessarily have a timeline and a frame-rate (which are, therefore,essential elements for the fruition of a video clip).

It is therefore one object of the invention to provide a system for thecreation of interactive audio-video contents of the live-action type forcontrollable/manoeuvrable mobile terminals, as a sequence of videoclips, through the use of a plurality of sensors, actuators and commandsfor managing, controlling and manipulating a frame in the video clip,which affect the timeline (time) and the frame-rate (speed) of the videoclip.

The present invention relates to a method for the creation ofinteractive audio-video contents of the live-action type in a mobileuser terminal, said contents being adapted to be controlled andmanoeuvred by the user through visualization on an interactive displayof said mobile terminal, comprising the following steps:

-   -   providing at least one set of interconnected video segments in        said mobile terminal, adapted to evolve in time, starting from        an initial video segment, through one or more selectable        intermediate video segments, up to one or more selectable final        video segments, each video segment comprising a non-interactive        video clip having a given, or even null, duration, and an        interactive node, said interactive node acting as an        interconnection with one or more other video segments of said        set, each interactive node comprising a loop interval subject to        automatic cyclical forward and backward time evolution, when        selected,    -   providing at least one set of commands in said mobile terminal,        adapted to determine said connection selections among said video        segments, wherein said commands can be activated during at least        one of said loop intervals,    -   in at least one of said loop intervals, association between said        commands and video segments of said one or more other video        segments.    -   upon activation of a command during said loop interval, exiting        said interval in a fluid and soft manner towards another video        segment selected among said one or more other video segments in        which said interactive audio-video content continues, depending        on the command issued among said set of commands, starting from        said initial video segment and ending in one of said final video        segments, so as to create said interactive audio-video content        on said interactive display as a sequence of said video segments        not known a priori, i.e. a filmic narration which is fluid and        continuous, modified and controlled in real time by the        user/spectator, without image jumps when switching between        successive video segments in said nodes.

Said commands in the mobile terminal are derived from correspondingcommands:

-   -   issued through a plurality of sensors included in the user        terminal;    -   issued through software commands in the terminal; or    -   issued through any combination of the above.

It is another object of the present invention to provide a method ofassociation between commands of evolution in time of an interactiveaudio-video content of the live-action type and video segments composingsaid interactive audio-video content in a mobile terminal, comprisingproviding in said mobile terminal one or more loop intervals subject toautomatic cyclic forward and backward time evolution in said videosegments, and executing at least one of said commands in said mobileterminal during said one or more loop intervals to determine saidevolution in time of the interactive audio-video content as a path amongsaid video segments.

The present invention further relates to a system and a user terminalfor implementing the method.

It is a particular object of the present invention to provide a methodfor the creation of interactive audio-video contents of the live-actiontype for mobile terminals, an electronic system for the implementationof the method, and a mobile terminal for using the method, as set out inthe claims, which are an integral part of the present description.

BRIEF DESCRIPTION OF THE DRAWINGS

Further objects and advantages of the present invention will becomeapparent from the following detailed description of a preferredembodiment (and variants) thereof referring to the annexed drawings,which are only supplied by way of non-limiting example, wherein:

FIG. 1 shows an example of a video-clip assembly structure for thecreation of interactive audio-video contents of the live-action type formobile terminals according to the present invention;

FIGS. 2, 5, 8.1, 8.2, 9.1, 9.2 show some details of the structure ofFIG. 1;

FIG. 3 shows an example of the structure of a video segment according tothe present invention, with visualization on a display;

FIGS. 4, 10, 11, 12.1, 12.2, 12.3 show some examples of commands appliedto loop sections of the video segments for building the interactiveaudio-video contents;

FIGS. 6, 7 are flow charts of the control software structure of themethod of the present invention.

In the drawings, the same reference numerals and letters identify thesame items or components.

DETAILED DESCRIPTION OF SOME EMBODIMENTS

As aforesaid, it is one object of the invention to provide a method forthe creation of controllable/manoeuvrable interactive audio-videocontents of the live-action type for mobile user terminals, as asequence of video clips, through the use of a plurality of sensors andcommands for managing, controlling and manipulating a frame in the videoclip, which affect the timeline (time evolution) and the frame-rate(speed) of the video clip. In the present context, the interactiveaudio-video contents of the “live-action” type are meant to be“live-action” or “real-action” contents, i.e. films played by “real”actors, as opposed to films created through animation (drawing, computergraphics, stop-motion, etc.)

Thanks to the invention described herein, it is possible to enjoy“live-action” video narration that can instantly show, without solutionof continuity, the results of the video-clip composition actions with nopauses, loadings or interruptions, as a sequence of video segments notknown a priori, i.e. a fluid and continuous filmic narration, modifiedand controlled in real time by the user/spectator, with no image jumpswhen switching between successive video segments in the nodes, as willbe described hereinafter.

The basic idea of the invention is, therefore, to provide a method forthe creation of controllable/manoeuvrable interactive audio-videocontents of the live-action type and a video editor that allows creatingindependent audio-video contents encapsulated into suitable APPs orreadable by a video player capable of recognizing and appropriatelyreacting to the controls and commands issued by the user through the useof any mode of interaction available in his/her mobile terminal,modifying in real time the succession of the video segments and hencethe contents of the filmic narration.

MANOEUVRABLE INTERACTIVE VIDEO refers to a filmic narration wherein thetime succession of the scenes (also called montage or direction) is notdefined a priori by the author of the video, but is built in real timeas a function of the interactions and selections INTERACTION COMMANDSmade by the spectator (or user) during fruition.

The MANOEUVRABLE INTERACTIVE VIDEO (FIG. 1) is composed of a set ofvideo narrations or VIDEO SEGMENTS 101.

VIDEO SEGMENTS are joined together at narrative points called NODES 103.

A VIDEO CLIP (FIG. 5) is the NON-INTERACTIVE OR NON INTEROPERABLE orNON-MANOEUVRABLE filmic narrative element of a MANOEUVRABLE INTERACTIVEVIDEO 102.

A NODE 103 is the point of interconnection among different VIDEOSEGMENTS.

The NODE is also the INTERACTIVE OR INTEROPERABLE or MANOEUVRABLE filmicnarrative element of a MANOEUVRABLE INTERACTIVE VIDEO.

A VIDEO CLIP is the time-successive aggregation of video takes orcontents, called SEQUENCES—see FIG. 8.1:

Video clip=Sequence₁+Sequence₂+Sequence₃+ . . .+Sequence_(n-1)+Sequence_(n)

At the end of each video clip there is a node sequence or Sequence_(n)or NODE.

A node sequence is a filmic take characterized by a series of [timemarkers], defined as follows:—see FIG. 8.2.

-   -   TLi Loop start time    -   TLf Loop end time    -   Tf1 . . . Tfn Forward time 1 . . . Forward time n    -   Tb1 . . . Tbn Backward time 1 . . . Backward time n        Wait interval or LOOP 821 refers to the narration between the        markers TLf 822 and TLi 823.

The markers Tfi 826,827 and Tbi 824,825 are referred to as exit points.

To each exit point, the start 828 of a VIDEO SEGMENT is connected, seeFIG. 1.

A node sequence may be the termination of several VIDEO SEGMENTS 109.

From one node sequence, several VIDEO SEGMENTS 109 may start.

The node sequences without exit points are called narration endings105-108.

Given the above definitions, it is assumed that it is per se known howeach video clip can be created, which is made up of a sequence of knownvideo and audio frames in a per se known digital format, e.g. 2D or 3D.

With reference to FIG. 1, in a per se known manner a MULTISTORY ispredetermined, i.e. a database of video segments and the multipathnetwork of interconnections among them (or quest tree), which may allowthe composition of an interactive audio-video content, consisting of oneof the possible clip sequences made possible by the clipinterconnections in the multipath network, starting from the startinstant of a first clip START 104 up to the end instant of one of the Npossible final clips (narration endings), referred to in the figure asEND1, . . . . ENDn 105-108.

The lines in the network symbolize the evolution in time of each clip,while the nodes symbolyze the transitions from one clip to another.Several video clips may meet at one node and/or several lines may startfrom one node, meaning that it is possible to switch from one clip toone or more other clips according to the specific mode of the inventiondescribed below.

Entry into the node or into the node sequence occurs at the instant TLi822, i.e. the start point of the wait interval, in which the evolutionof the clip occurs automatically, cyclically and continuously forwardsand backwards (rewind) between TLI (822) and TLf (823), see FIG. 2.

Within this automatic cyclic evolution (from instant TLi to instantTLf), the system is in Loop (201), waiting to receive a command forevolving towards another clip, through any one of the commands ofinteraction between the mobile terminal and the user, which command mayarrive at any instant within the loop, according to the decision of theuser, who chooses the instant for exiting the loop, thus obtaining asoft transition from one clip to the next one.

Optionally, the system may evolve automatically towards another clip, ifno commands are received from the user within a MAXIMUM TIME.

Optionally, the wait interval of a node sequence can be reproduced onlyonce (no loop). This permits the creation of situations where, if theuser interacts with the correct “interactive instruction” within thewait interval, then the narration will continue following the mainnarrative flow; otherwise. i.e. if no command or a wrong command isissued, different video segments will be linked.

Optionally, the system may automatically handle the timeline andframe-rate of the loop (e.g. for slowing down the scene, . . . ) whilewaiting for a command from the user.

The types of available commands 202 are many and can be issued throughspecific user actions, such as the following:

-   -   a plurality of sensors, such as touch-pad, microphone,        gyroscope, camera, . . .    -   a plurality of gestures, such as swipe, pinch, . . .    -   a plurality of combinations of the above sensors and gestures, .        . .        or issued through [software commands] 203, e.g. generated by        timers (e.g. maximum time of permanence of the wait interval) or        as a consequence of other commands generated by the user (e.g.        parallel multistories, wherein a user command issued for a first        multistory also results in a software command affecting the        second multistory).

These commands are already known and available, for example, in sometypes of mobile telephone terminals, such as smartphones, beingtransformed in a known manner into electric and/or electronic controlsignals in the terminal.

The user terminal comprises an interactive display and/or one or moresensors, from which at least some of said commands can be derived,and/or one or more motion or voice or image or position detectors, fromwhich at least some of said commands can be derived.

Based on the specific command received, issued within the wait interval,the system determines how the transition from one clip to another clipshould evolve.

This means that, based on the type of command received in the loop (e.g.fast or slow shaking of the motion sensor), the time evolution of thenode sequence will be modified by managing the flow speed and directionand the point where a jump to the next clip should occur within the nodesequence.

Therefore, based on the type of command issued, the system will decidehow the node sequence should evolve (forwards, backwards, fast, slow, .. . ) and hence also the point of the node sequence (301, 302, 305, 306)from which to go towards another clip, see FIG. 3 (interactiveinstruction).

For every single node within the system, a matching table is definedbetween command types and evolution types.

There is a user interface that senses the command issued by the user andassociates it with the type of reaction affecting the evolution of theclip.

The available commands may depend on the node, and may therefore bedifferent for each node sequence.

Some node sequences may not be associated with any commands, andtherefore may not contain a narration endings loop 105-108.

Some node sequences may consist of the loop only, so that it will bepossible to jump from a loop directly to a subsequent segment or loop110.

With reference to FIG. 2, the evolution of the VIDEO CLIP 204 ends intoa WAIT INTERVAL or LOOP 201. Based on the command COM received 202,203,the table of possible command/transition combinations will determine theexit time marker and the next video segment.

If the exit time marker is placed before the start of the loop, then thesystem will move backwards, by appropriately adjusting the timeline andframe-rate, up to the exit point, thus linking to the next video segment205.

If the exit time marker is placed after the end of the loop, then thesystem will move forwards, by appropriately adjusting the timeline andframe-rate, up to the exit point, thus linking to the next video segment206.

For example, if during the wait interval (loop) a swipe right command402 is issued (FIG. 4), then the node sequence will be executed inforward mode past the TLF marker (310) up to TF1 (311); if a two swiperight command 404 is issued, then the clip will go forwards past themarker TF1 311, up to the marker TF2 (312), displaying the associatedvideo segment.

If during the wait interval (loop) a swipe left command 401 is issued(FIG. 4), then the node sequence will be executed in backward mode pastthe TLI marker (309) up to TB1 (308); if a two swipe left command 403 isissued, then the clip will go backwards past the marker TB1 308, up tothe marker TB2 (307), displaying the associated video segment.

INTERACTION COMMANDS can only be issued, and hence interpreted, duringthe execution of the [Wait interval].

Management commands are, on the contrary, commands not related tointeraction, and can be issued at any instant during multistory fruitionor development, e.g. in order to impose a rewind action following awrong or unpleasant selection or to jump to a previous clip.

According to a further variant, the same command issued at differenttime instants within the wait interval may execute the exit from thenode sequence in different ways.

The wait segment is divided into n time intervals ΔT (304) andassociated with an interactive instruction. One Clip(n) will beassociated with each ΔT—see FIG. 9.1.

According to a further variant, it is possible to assign differentcommands to the same time interval ΔT within the wait interval in orderto develop the node sequence in different ways.

In a given time interval ΔT, a defined Clip(n) corresponds to eachinteractive instruction, see FIG. 9.2.

According to a further variant, if the wait interval of a node sequenceis a video taken at a frame-rate higher than 24 fps (e.g. 300 fps), thecommands of the interactive instruction may increase or decrease theframe-rate of the node sequence.

For example (see FIG. 10), upon the given interactive instruction (e.g.tap) at any point within the wait interval, the frame-rate decreases(slows down) to allow for better observation of the flight of thehumming bird (1001) or, vice versa, the frame-rate increases(accelerates) to allow observing the humming bird in action (1002).

For example (see FIG. 11), in the node sequence with a wait interval,upon the given interactive instruction (e.g. tap), in a given timeinterval, the frame-rate decreases (slows down) to allow increasing theprecision of the jump and prevent falling (1102); in fact, should thegiven interactive instruction be executed in a wrong manner or out ofsync, then the player will not land precisely on the nearest bank, thusfalling into the void (1106).

As an alternative to the given interactive instruction (e.g. tap), in agiven time interval the frame-rate increases (accelerates) to allowincreasing the elevation of the jump to reach the opposite bank (1104);should the given interactive instruction be executed in a wrong manneror out of sync, the player will not take sufficient run-up and will fallinto the void, thus not reaching the opposite bank (1107).

Within the same wait segment there may be several interactiveinstructions, in different time intervals (1101-1105).

According to a further variant, based on further types of commands(interaction and management commands) received, simultaneousside-by-side visualization of two or more MULTISTORIES is obtained, eachone possibly having a timeline of its own subject to different commands,at different times.

With reference to FIG. 12.1, two or more node sequences can be executedon the same display, whether in different layouts or superimposed. Theinteractive instructions assigned to combined node sequences may be:

a) mutually independentb) mutually interactive

In case of simultaneous vision of multiple multistories, a user commandissued on one multistory may be associated with software commandscapable of causing the parallel evolution of one or more node sequencesof other multistories.

Example of combined node sequences with independent interactiveinstructions: with reference to FIG. 12.2, according to the timelinehighlighted in red the humming bird can go into slow motion upon theassigned interactive instruction (e.g. tap); according to the timelinehighlighted in green, the humming bird can fly off upon the assignedinteractive instruction (e.g. swipe up). The two node sequences combinedtogether do not affect the respective timelines, framerates orinteractive instructions by any means.

The combined node sequences can be manoeuvred either simultaneously (atthe same instant) or separately (at distinc instants); they will needdifferent interactive instructions in the former case or, in the lattercase, indifferent ones.

Example of combined node sequences with complementary interactiveinstructions: with reference to FIG. 12.3, according to the timelinehighlighted in red the humming bird 1231 can go into slow motion uponthe assigned interactive instruction (e.g. tap); at the same time, thetimeline highlighted in green waits in Loop for the sequence highlightedin red to respond to the interactive instruction; once the interactiveinstruction of the sequence highlighted in red has been executed, thegreen sequence will execute the clip past the marker (in the drawing,the humming bird 1233 can reach the humming bird 1234, if the hummingbird 1231 makes a precise landing). The two node sequences combinedtogether affect the respective timelines, frame-rates or interactiveinstructions, because the evolution of one of them implies a differentevolution of the other.

The following will explain in more detail the operating sequence of thesystem/method with reference to

-   -   FIGS. 6 and 7, which show the operating flow charts.    -   FIGS. 8.1 and 8.2, which show the composition of a video clip,        and    -   FIGS. 3 and 4, which show some examples of interaction with a        user terminal.

With reference to the flow chart of FIG. 6:

From a given App Store (e.g.: Apple Store or Google Play), the userdownloads an .IPA file (or a file in an equivalent format) to his/herown device (smartphone or tablet) (block 61).

The .IPA file (or file in an equivalent format) downloads to the memoryof the device a library of [VIDEO CLIPS] and layouts/templates coded incomputer languages (e.g.: C++) compatible with iOS, Android and otheroperating systems (block 62).

By clicking on the icon of the .IPA file (or file in an equivalentformat), the Application is executed (block 63).

The initial interface is the menu of the Application, which includes,among others, the “START” button (or equivalent commands, e.g.: BEGIN,START, etc.) (block 64 and FIG. 9.1).

The video player displays the first [VIDEO CLIP] or [INITIAL CLIP](block 65 and FIG. 9.2).

The flow continues from FIG. 6 to FIG. 7.

With reference to the flow chart of FIG. 7 and to FIGS. 8.1, 8.2:

The software by means of computer code (e.g.: C++) compatible with theoperating system of the device (smartphone or tablet) executes theassigned VIDEO SEGMENT, linking in succession the SEQUENCES of the VIDEOCLIP (block 70).

The last sequence Sequence_(n) or Node Sequence is connected toSequence_(n-1) at the instant TLi (block 71), i.e. the frame of the NodeSequence identified by the time marker TLi will be linked—insuccession—to the last frame of Sequence_(n-1).

If the Node Sequence is a final sequence or [Narration ending], theprocedure will end (END) (block 72), otherwise it will continue.

If the procedure goes on, the video clip will move forwards andbackwards in the time segment between the markers TLi and TLf [Waitinterval], waiting for a command action from the user (block 73 and303).

The software by means of computer code (e.g.: C++) compatible with theoperating system of the device (smartphone or tablet) may alsoappropriately adjust the running speed of the [Wait interval], slowingdown or accelerating the frame-rate in order to give more realism to thewait situation (block 74).

When the reception of a [command] is verified (block 75), the softwareby means of computer code (e.g.: C++) compatible with the operatingsystem of the device (smartphone or tablet) associates a given gestureof the touchscreen (e.g.: swipe, tap, rotate, etc.) or a given input ofthe sensors of the device (e.g.: gyroscope, volume, etc.) or a givensoftware command with a given time direction (backwards or forwardsrelative to TLi or TLf) and/or with a given frame-rate of the video clip(acceleration or slowing down) and/or with a given combination of bothfactors (time direction+frame-rate (block 77, FIG. 4).

If absence of interactions is verified (block 75), then the loop betweenTLi and TLf will continue (block 76), and the operations will return toblock 73 (303).

In the presence of a command from the user or from the software, theprocedure will exit the loop of the wait interval, moving forwards orbackwards to the time marker Exit point connected to that user action orcommand (block 78, 307-308, 311-312).

When the Exit point is arrived at, the software selects from the library(see point 2) the new VIDEO SEGMENT associated with the type ofselection and/or command just executed (block 79).

The video player displays the new VIDEO CLIP (block 80).

The process starts again from the beginning (block 70).

The result is a succession of VIDEO SEGMENTS, the evolution ofwhich—MANOEUVRED by the user's actions—produces a narrativeexperience—characterized by the choices of the user him/herself—that isunique, original and involving as a whole.

The present invention can advantageously be implemented through acomputer program VIDEO EDITOR, which comprises coding means forimplementing one or more steps of the method when said program isexecuted by a computer.

The following will list the steps of the process of using the methodthrough the VIDEO

Editor:

a) Given a library of (n), composed of all video sequences (including,therefore, all possible branches of the Multistory), the computer expert[OPERATOR] selects the sequences for composing the [VIDEO SEGMENTS],including the sequences transformed into node sequences.b) On the timeline of the node segment, the computer expert sets twotime markers that delimit the backward and forward loop Wait interval ofthe node sequence. In this way, the node sequence will only be executedin backward and forward loop within the two time markers set on thetimeline.c) On the timeline within the Wait interval, the computer expert may setother additional time markers, as a function of the interaction gesturesexpected by the narrative development of the Multistory.d) On the timeline of a video segment, the computer expert also sets any[exit time markers] and connection markers towards the next videosegments, in accordance with the narrative construction of theMultistory.e) The computer expert selects a given command readable by the mobiledevice (smartphone and/or tablet) relating to gestures and sensors ofthe device capable of sending executable inputs (e.g.: gesture on thetouchscreen, voice command through the microphone, rotation of thegyroscope, etc.).f) At each time marker set within the wait interval, the computer expertassociates the previously selected command, so that upon that givencommand the node sequence will be executed past the markers delimitingthe wait interval [TLi, TLf], up to the time markers connected with theassociated command.g) The computer expert selects from the library the video segments thatwill follow the executed node sequence based on the associated command;in this way, a given video segment(n) will correspond to the givencommand associated with the time marker and to the relevant “unlocked”part of the node sequence.h) The computer expert repeats the same process using all the nsequences in the library, alternating video clips and node sequences soas to create the plurality of possible narrative directions of theMultistory [or “quest tree” ].i) Once the quest tree has been formed and closed, the expert exportsthe project as an .IPA or equivalent file readable by the App Stores(e.g.: Apple Store, Google Play, etc.).

It is therefore understood that the protection scope extends to saidcomputer program VIDEO EDITOR as well as to computer-readable means thatcomprise a recorded message, said computer-readable means comprisingprogram coding means for implementing one or more steps of the methodwhen said program is executed by a computer.

The above-described non-limiting example of embodiment may be subject tovariations without departing from the protection scope of the presentinvention, comprising all equivalent designs known to a man skilled inthe art.

The elements and features shown in the various preferred embodiments maybe combined together without however departing from the protection scopeof the present invention.

The advantages deriving from the application of the present inventionare apparent, as described below by way of example.

Soft switching from one clip to the next is obtained.

In prior-art systems, in order to obtain different types of clipevolution, different clips are created, among which the user makes aselection. According to the present invention, on the contrary, theevolution of the clip itself is modified.

In prior-art systems, overlays or hyperlinks are added to obtaininteractions, which however distract from pure fruition of the videoclip (the term “pure” referring herein to viewing the video clip with noadditional elements). According to the present invention, on thecontrary, the video clip is directly acted upon without requiring theuse of any additional elements on the video clip.

From the above description, those skilled in the art will be able toproduce the object of the invention without introducing any furtherconstruction details.

1. Method for the creation of interactive audio-video contents, throughvisualization on an interactive display, comprising the following steps:providing at least one set of interconnected video segments (101),adapted to evolve in time, comprising an initial video segment (START)and one or more final video segments (END1, . . . ENDn), each videosegment comprising a non-interactive video clip (102) having a given, oreven null, duration, and an interactive node (103), said interactivenode acting as an interconnection with one or more other video segments,each interactive node comprising a loop interval (TLi, TLf) subject tocontinuous cyclical forward and backward time evolution, providing atleast one set of commands (202) adapted to determine connection choicesamong said video segments, wherein said commands can be activated duringat least one of said loop intervals, in at least one of said loopintervals, association between said commands and video segments of saidone or more other video segments, upon activation of a command duringsaid loop interval, exiting said interval and continuing in that videosegment of said one or more other video segments in which saidinteractive audio-video content continues, depending on the commandchosen from said set of commands, starting from said initial videosegment (START) and ending in one of said final video segments (END1, .. . ENDn), so as to create an interactive audio-video content on saidinteractive display as a sequence of said video segments.
 2. Methodaccording to claim 1, wherein said interactive node (103) comprises anode sequence of video content comprising said loop interval and furtherforward and backward time continuation intervals around said loopinterval, time markers being set: in said loop interval as startinstants (TLi) and end instants (TLf) of the continuous cyclical forwardand backward time evolution; in said further forward time continuationintervals (Tf1 . . . Tfn); in said further backward time continuationintervals (Tb1 . . . Tbn); each time marker in said further forward andbackward continuation intervals corresponding to the instant when theinteractive audio-video content continues in one of said one or moreother video segments, the start instant of which is associated with oneof said time markers.
 3. Method according to claim 2, wherein a commandcoming at different time instants within a loop interval determines theexit from the node sequence in different ways towards different furthervideo segments.
 4. Method according to claim 2, wherein said nodesequence evolves at an increased or decreased frame-rate, if the loopinterval has a frame-rate that is higher than the standard one. 5.Method according to claim 1 or 2 or 3 or 4, wherein more than one set ofinterconnected video segments (101) are provided, and said commands candetermine the evolution of said interactive audio-video content in anyone of said sets of interconnected video segments (101) or, in parallel,in each one of said sets of interconnected video segments (101). 6.Method according to claim 1 or 2 or 3 or 4 or 5, wherein, if no commandis received within a maximum time of evolution of said loop interval, anautomatic evolution towards another video segment or an end of saidcreation of an interactive audio-video content will be determined. 7.Method according to any one of the preceding claims, wherein saidcommands (202) are derived from corresponding commands available on auser terminal, which can be activated by means of: a plurality ofsensors of the terminal; a plurality of gestures of the terminal;software commands (203) in the terminal; any combination of the above.8. System for the creation of interactive audio-video contents, throughvisualization on an interactive display, comprising means forimplementing the method according to any one of the preceding claims. 9.User terminal for the creation of interactive audio-video contents,comprising means for implementing the method according to any one ofclaims 1 to 7, and comprising: an interactive display and/or one or moresensors, from which at least some of said commands can be derived,and/or one or more motion detectors, from which at least some of saidcommands can be derived.
 10. Method of association between commands ofevolution in time of an interactive audio-video content and videosegments composing said interactive audio-video content, comprisingproviding one or more loop intervals (TLi, TLf) subject to continuouscyclical forward and backward time evolution in said video segments, andexecuting at least one of said commands during said one or more loopintervals to determine said evolution in time of the interactiveaudio-video content as a path among said video segments.
 11. Userterminal comprising means for implementing an association betweencommands of evolution in time of an interactive audio-video content andvideo segments composing said interactive audio-video content, saidmeans providing one or more loop intervals (TLi, TLf) subject tocontinuous cyclical forward and backward time evolution in said videosegments, and for executing at least one of said commands during saidone or more loop intervals to determine said evolution in time of theinteractive audio-video content as a path among said video segments.